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1 Introduction 



It is a well-known theorem of Garret Birkhoff [3] and von Neumann [6], pQ, [2] that 
the extreme points in the convex set of all n x n bistochastic (or doubly stochastic) 
matrices are precisely the n-th order permutation matrices. Here we address the following 
problem: If G is a standard Borel group acting measurably on two standard probability 
spaces (Xj, jFj, /ij), i = 1,2 where ^ is invariant under the G-action for each i then 
what are the extreme points of the convex set of all joint probability distributions on the 
product Borel space (X\ x^,^® T%) which are invariant under the diagonal action 
(xy, x<i) i — ► (gxi, gx-z) where Xi G X iy % = 1, 2 and g G Gl 

Our approach to the problem mentioned above is based on a quantum probabilistic 
method arising from Stinespring's |5j description of completely positive maps on C* 
algebras. We obtain a necessary and sufficient condition for the extremality of a joint 
distribution in the form of a regression condition. This leads to examples of extremal 
nongraphic joint distributions in the unit square with uniform marginal distributions on 
the unit interval. The Birkhoff- von Neumann theorem is deduced as a corollary of the 
main theorem. 

2 The convex set of covariant bistochastic maps on 
C* algebras 

For any complex separable Hilbert space H, express its scalar product in the Dirac 
notation (-|-) and denote by 13(H) the C* algebra of all bounded operators on H. Let G 
be a group with fixed unitary representations g \— > U g , g i— > V g , g G G in Hilbert spaces 
7ii, TC2 respectively and let Ai C 13 (Hi), i = 1,2 be unital C* algebras invariant under 
respective conjugations by U g , V g for every g in G. Let u>i be a fixed state in Ai for each 
i, satisfying the invariance conditions: 

u) X {U g XU; 1 ) = ui{X),u 2 {V g YV- x ) = u 2 (Y) V X G Ay, Y G A 2 ,g G G. (2.1) 



2 



Consider a linear, unital and completely positive map T : Ai — > A2 satisfying the 
following: 

v 2 (T(X)) = u x (X) V X G Ai, (2.2) 

T{U g XU g l ) = V g T{X)V g ~ l VXeA h geG. (2.3) 

Then we say that T is a G-covariant bistochastic map with respect to the pair of states 
ct>i,a>2 and representations U., V.. Denote by K the convex set of all such covariant 
bistochastic maps from Ai into A%. We shall now present a necessary and sufficient 
condition for an element T in K to be an extreme point of K. 

To any T G IK we can associate a Stinespring triple (JC,j,T) where JC is a Hilbert 
space, j is a C* homomorphism from A% into B(fC) and T is an isometry from Ti,2 into 
K, satisfying the following properties: 

(i) rtj(x)r = T(x) vxeAf, 

(ii) The linear manifold generated by {j(X)Tu\u G Ti.2,X G A\} is dense in /C. 

Such a Stinespring triple is unique upto a unitary isomorphism, i.e., if (K!,j',V) is 
another triple satisfying the properties (i) and (ii) above then there exists a unitary 
isomorphism 9 : K -»• K' such that 9j(X) = j'(X)6 VI G A\ and = T'v V u G 
(See 0.) 

We now claim that the covariance property of T ensures the existence of a unitary 
representation g \— > W g of G in K satisfying the relations: 

W g3 (X)Tu = j{U g XU g l )TV g u VXeAi,geG,ueH 2 , (2.4) 
W g3 (X)W g - 1 = 3 iU g XU; 1 ) VXeAugeG. (2.5) 

Indeed, for any X, Y in Ai u, v G H2 and g G G we have from the properties (i) and (ii) 
above and (12. 3p 

(j {u g xu; 1 ) vv g u\j (u.yu; 1 ) rv g v) 

= i;u\V g - l T{U g X^YU; l )V g v) 
= (u\T(X*Y)\v) 
= (j(X)Tu\j(Y)Tv). 
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In other words, the correspondence j(X)Tu i— > j(U g XU g 1 )TV r g M is a scalar product 
preserving map on a total subset of /C, proving the claim. 

Theorem 2.1 Let T G IK and let (/C,j, T) be a Stinespring triple associated to T. 
Let g I— > W s be the unique unitary representation of G satisfying the relations (12.41) and 
(12. 5p . Then T is an extreme point of IK if and only if there exists no nonzero hermitian 
operator Z in the commutant of the set {j(X),X G A\} U {W g ,g G G} satisfying the 
following two conditions: 

(i) rtzr = o ; 

(ii) PZj(X)T G A 2 and uj 2 (PZj(X)T) =0 V X G A x . 

Proof Suppose T is not an extreme point of K. Then there exist 7\, T 2 G K, Ti ^ T 2 
such that T = |(Ti + T 2 ). Let ()Ci,ji, Ti) be a Stinespring triple associated to T x . Then 
by the argument outlined in the proof of Proposition 2.1 in [4] there exists a bounded 
operator J : K —*■ K\ satisfying the following properties: 

(i) Jj(X)Tu = ji(X)T lU V X g A h u G H 2 ; 

(ii) The positive operator p := J^J is in the commutant of {j(X),X G A} in B(JC); 
(hi) T 1 (X) = T^pj(X)T. 

Since 7^ T 2 it follows that T\^T and hence p is different from the identity operator. 
We now claim that p commutes with W g for every g in G. Indeed, for any X, Y in Ai, 
u, v in 7i 2 we have from the definition of p and J, equation (12.41) and the covariance of 
Ti 

(j(X)Tu\pW g \j(Y)Tv) 
= {]{X)Tu\fj\j{U a YU- l )TV g v) 

= 0' 1 (x)r lM | J1 (f/ 3 rf/ 9 - 1 )r 1 v) 
= («|r t 1 i 1 (xtc/ g yc/- 1 )r 1 |v) 
= (u^ix^u^u- 1 )^) 
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On the other hand, by the same arguments, we have 



(j(X)Tu\W g p\j(Y)Tv) 
= {j{U; l XU g )TV- l u\jU\j{Y)Tv) 

Comparing the last two identities and using property (ii) of the Stinespring triple we 
conclude that p commutes with W g . Putting Z = p — / we have 

T^Zj(X)T = T X {X) - T{X) V X G Ay. (2.6) 

Clearly, the right hand side of this equation is an element of A2 and 

u 2 (T ] Z](X)T) = uy{X) - uy(X) = V X e A%. 

Putting X = I in (I2.6p we have T^ZT = 0. Then Z satisfies properties (i) and (ii) in the 
statement of the theorem, proving the sufficiency part. 

Conversely, suppose there exists a nonzero hermitian operator Z in the commutant of 
{j(X),X G A\} U {W g ,g G G} satisfying properties (i) and (ii) in the theorem. Choose 
and fix a positive constant e such that the operators / ± eZ are positive. Define the 
maps T± : Ai — > A2 by 

T ± (X) = r + (J ± eZ)j(X)T, X G Ay. (2.7) 

Since 

(/ ± eZ)j(X) = VI ±eZj(X)Vl ±eZ 

it follows that T± are completely positive. By putting X = I in f)2.7p and using property 
(i) of Z in the theorem we see that T± are unital. Furthermore, we have from equations 
( EUD and ([23D, for any g G G, X G Ay, 

T^U^U; 1 ) = Y\l±eZ)W gJ {X)W; 1 T 
= V g Y^I±eZ)j{X)YV- 1 
= V g T ± (X)V-\ 
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Also, by property (ii) in the theorem we have 



cu 2 (T±(X)) = uj 2 (T(X)) =uj 1 {X) VIGA. 



Thus T± G K. Note that 



(u\V^Zj(X^Y)V\v) = (j(X)Tu\Z\j(Y)Tv) 



cannot be identically zero when X and Y vary in Ai and u and v vary in H 2 . Thus 
T^Zj(X)T ^ and hence T + ^ T_. But T = |(T+ + T_). In other words T is not an 
extreme point of K. This proves necessity. □ 

3 The convex set of invariant joint distributions with 
fixed marginal distributions 

Let (Xi, Ti, Hi), % — 1,2 be standard probability spaces and let G be a standard Borel 
group acting measurably on both X 1 and X 2 preserving ^ and /i 2 . Denote by K(/xi,/x 2 ) 
the convex set of all joint probability distributions on the product Borel space (X i: xX 2 , 
T\ ®J- 2 ) invariant under the diagonal G action (g, (x±, x 2 )) \— > (gxi,gx 2 ), Xi G X^ g G G 
and having the marginal distribution in Xi for each i. Choose and fix uj G K((j,i,/i 2 ). 
Our present aim is to derive from the quantum probabilistic result in Theorem 2.1, a 
necessary and sufficient condition for uj to be an extreme point of K(/ii, ji 2 ). To this end 
we introduce the Hilbert spaces Hi = L 2 (fXi), K, = L 2 (uo) and the abelian von Neumann 
algebras Ai C 13 (Hi) where Ai = L°°(//j) is also viewed as the algebra of operators of 
multiplication by functions from L°°(/Xj). For any ip G we shall denote by the 

same symbol ip the multiplication operator / i— > ipf, f G L 2 (jii). For any <p G Ai define 
the operator j({p) in /C by 



Then the correspondence ip i— > j(v^) is a von Neumann algebra homomorphism from 
into £>(/C). Define the isometry r : H 2 — > /C by 



(jM/X^i,^) = ¥»(xi)/(a;i,a:2), / G /C,^ G 



(3.1) 



(ri))(xi,x 2 ) = v(x 2 ), veH 2 . 



(3.2) 
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Then, for / G 1C, v G H 2 we have 



(f\Tv) = / f(x 1 ,x 2 )v(x 2 )u(dx 1 dx 2 ) 

JX 1 xX 2 

(Jv(dx 2 ) [f(x 1 ,x 2 )u(dx 1 ,x 2 )] v(x 2 ) 

x 2 

where is(E,x 2 ), E G T\, x 2 G X 2 is a measurable version of the conditional probability 
distribution on T\ given the sub a-algbera {X\ x F,F £ T 2 } C T\®T 2 . Thus the adjoint 
: /C — > of T is given by 

(T J( f)(x 2 )= f(x 1 ,x 2 )v(dx 1 ,x 2 ). (3.3) 
J x x 

Hence 

{j((p)Tv)(x 1 ,x 2 ) = (p(xi)v(x2), p G Ai, veH 2 , (3.4) 



(rtj»r^)(x 2 ) 

In other words 



cp(x 1 )u(dxi, x 2 ) 



v(x 2 ). (3.5) 



r*j{<p)r = T{<p) (3.6) 

where T(y?) G A 2 is given by 



T((p)(x 2 ) = (p(xi)u(dx u x 2 ). (3.7) 

Equations (13. lft - (13. 71) imply that T is a linear, unital and positive (and hence completely 
positive) map from the abelian von Neumann algebra A.% into A 2 and (/C, j, T) is, indeed, 
a Stinespring triple for T. Furthermore, the unitary operators U g , V g and W 9 in TCi, H 2 
and /C respectively defined by 

(U g u){xi) = m(5( _1 xi), u£Hi, 
(V g v)(x 2 ) = v(g~ x x 2 ), v G H 2 , 
(W g f)(x u x 2 ) = f(g' 1 x l , (7 _1 x 2 ), f E k 

satisfy the relations (I2.4p and (12.51) . 

Our next lemma describes operators of the form Z occurring in Theorem 2.1. 

Lemma 3.1 Let Z be a bounded hermitian operator in /C satisfying the following 
conditions: 
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(i) Zjfa) = j(<p)z v <peA u 

(ii) ZW g = W g Z V geG, 

(ii) rtzj(y?)r eA 2 V^e4 

Then there exists a function £ G L°°(co>) satisfying the following properties: 
(a) Cfax, 9x2) = C(xi,x 2 ) a.e. (w) V g G G, 
(a) (Zf)(x 1 ,x 2 ) = C(x 1 ,x 2 )f(x 1 ,x 2 ) V / G /C 

Proof Let 

C(xi, x 2 ) = (Zl)(xi,x 2 ) 

where the symbol 1 also denotes the function identically equal to unity. For functions u, v 
on Xi,X 2 respectively denote by u®v the function on X x x X 2 defined by u®v(x%, x 2 ) = 
u(xi)v(x 2 ). By property (i) of Z in the lemma we have 

(Zip®l)(xi,x 2 ) = (Zj((f))l)(xi,x 2 ) 

= {j{^>)Zl){x 1 ,x 2 ) 

= ip{x 1 )({x 1 ,x 2 ) V <peAi. (3.8) 

If <p G Ai, v G 7^2, we have 

(Z<p®v)(x 1 ,x 2 ) = {Zj(ip)Tv)(x 1 ,x 2 ) 
= U( i f)ZTv)(x 1 ,x 2 ) 

= ip(x 1 )(Zl(g)v)(x 1 ,x 2 ) (3.9) 

From properties (i) and (iii) of Z in the lemma and equations ( 13. 3ft . ( 13.81) and ( 13.91) we 

have 

(r t Zj(v9)rt;)(x2) = J (Zip®v)v(dxi,x 2 ) 

= J (p(xi)(Zl ® v)(xi,x 2 )v(dxi,x 2 ) 
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whereas the left hand side is of the form R((p)(xi)v(x2) for some R((p) E L oc ( / u 2 ). Thus 

R(p)(x 2 )v(x 2 ) = J (p(xi)(Zl <g>v)(x 1 ,x 2 )v(dx 1 ,x 2 ). 
Choosing v = 1 we have from the definition of ( 

R(p)(x 2 ) = / (p(x 1 )C(x 1 ,x 2 )u(dx 1 ,x 2 ). 



Thus, for every p G Ai 

ip(xi)((x 1 ,x 2 )v(x 2 )iy(dx 1 ,x 2 ) — / (p(xi)(Zl <g) v)(xi, x 2 )u(dx 1 , x 2 ) 
and hence 

(Zl ® x 2 ) = ((x 1 , x 2 )v(x 2 ) a.e. x 1 (u(., x 2 )) a.e. x 2 (fi 2 ). 

Applying j(p>) on both sides we get 

(Zip ® x 2 ) = CO^i) ^VO^iM 3 ^) a.e. (a;). 

In other words Z is the operator of multiplication by ( and it follows that ( G L°°(u). 
Now property (ii) of Z implies property (a) in the lemma. □ 

Theorem 3.2 Let u G K(/xi,/x 2 ). Then u is an extreme point of K(/ii,/i 2 ) if and 
only if there exists no nonzero real- valued function ( G L°°(cj) satisfying the following 
conditions: 

(i) C(gxi, gx 2 ) = ((x 1: x 2 ) a.e. to \f g E G; 

(ii) E(C(6,6)|6) = 0, E(C(fi,6)|&) = where is an X x x X 2 - valued random 
variable with distribution a;. 

Proof Let Z be a bounded selfadjoint operator in the commutant of {j{p>), p E A\}U 
{W g ,g E G} such that T^Zj(p)T E A 2 M p E A x . Then by Lemma 3.1 it follows that Z 
is of the form 

(Zf)(x!,x 2 ) = ((x 1 ,x 2 )f(x 1 ,x 2 ) 
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where ( G 



L°°(uj) and ((gxi, gx 2 ) = ((xi,x 2 ) a.e. (uj). Note that 



(T ] ZYv)(x 2 ) = / ((x 1 ,x 2 )v(dx 1 , x 2 ) v(x 2 ) a.e. (/i 2 ), v E H 2 
Jxi 



Thus T^ZT = if and only if E(C(£i,6)|6) = 0. Now we evaluate 

(T^Zj(ip)Tv)(x 2 ) = / ip(x 1 )v(x 2 )((x 1 , x 2 )u(dx 1 , x 2 ) a.e. (/i 2 ) 



Looking upon r^Zj(<^)r as an element of A 2 and evaluating the state \i 2 on this element 
we get 



Thus fi 2 (T^Zj(ip)T) = V if E Ai if and only if E(C(6,6)|6) = 0. Now an application 
of Theorem 2.1 completes the proof of the theorem. □ 

We shall now look at the special case when G is the trivial group consisting of only 
the identity element. Let (X«, jFj, /ij), i — 1,2 be standard probability spaces and let 
T : X\ — > X 2 be a Borel map such that /i 2 = ^\T~ X . Consider an Xi-valued random 
variable £ with distribution //j. Then the joint distribution uj of the pair (£,T o £) is an 
element of fi 2 ) and by Theorem 2.1 is an extreme point. Similarly, if T : X 2 — > 
is a Borel map such that /x 2 T _1 = yUi and 77 is an X 2 -valued random variable with 
distribution yU 2 then (T o 77, 77) has a joint distribution which is an extreme point of 
K( / u 1 ,/j 2 ). Such extreme points are called graphic extreme points. Thus there arises 
the natural question whether there exist nongraphic extreme points. Our next lemma 
facilitates the construction of nongraphic extreme points. 

Lemma 3.3 Let (X, JF, A), (Y, Q, fi), (Z, /C, v) be standard probability spaces and let 
£, i], ( be random variables on a probability space with values in X, Y, Z and distribution 
A,//, v respectively. Suppose ( is independent of and the joint distribution uj of 

(£, i]) is an extreme point of K(A, ji). Let A, Jl, uj be the distributions of (£, Q, (77, () and 




E^(6)C(£i,6) 
E M1 ^!)E(C(6,6)|6)- 



10 



((£, C), (v, 0) respectively in the spaces X x Z, Y x Z and (X x Z) x (Y x Z). Then u; 
is an extreme point of K(A, /I). 

Proof Let / be a bounded real-valued measurable function on (X x Z) x (Y x Z) 
satisfying the relations 

E{/((e,o,fa,0)|fa,o} = o, 

E{/((e,C),fa,C))|&0} = o. 

If we write 

F z (x,y) = f((x,z),(y,z)) where (x,y,z)eXxYxZ 

then we have 

E(F z (C,v)\v) = 0, E(F z (e,77)|0 = a.e. 

Since uj is extremal it follows that F z (£, rf) — a.e. 2(1/) and therefore /((£, C), l 7 ?? 0) — 0. 
By Theorem 3.1 it follows that u is, indeed, an extreme point of K(A, JT). □ 

Example 3.4 Let A be the uniform distribution in the unit interval [0, 1]. We shall use 
Lemma 3.3 and construct nongraphic extreme points of K(A, A) which are distributions 
in the unit square. To this end we start with the two points space Z 2 = {0, 1} with the 
probability distribution P where 

P({0})=p, ^({1}) = ?, 0<p<q<l, p + q=l. 

Now consider Z 2 - valued random variables £, rj with the joint distribution given by 

P(£ = 0,77 = 0) = 0, P(£ = 0,77 = 1) = P(f = l, v = 0)=p,P(t = l, V = l) = q-p. 

Note that the joint distribution of (£, rf) is a nongraphic extreme point of K(P, P). Now 
consider an i.i.d sequence Ci>C2, • • • of Z 2 -valued random variables independent of (£,77) 
and having the same distribution P. Put 

C = (Ci,C2,--.)- 

Then by Lemma 3.3 the joint distribution uj of ((£, C)> 0) is an extreme point of 
K(z/, v) where v — P <g> P <g) ■ ■ ■ in Z^ 0,1 ' 2 '"'^. Furthermore, since (£, rf) is nongraphic so is 
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((£) 0) (v, C))- Denote by F p the common probability distribution function of the random 
variables 



Then F p is a strictly increasing and continuous function on the unit interval and therefore 



Then the joint distribution u of (£',?/) is a nongraphic extreme point of K(A, A). 

Now we consider the case when Xi and X 2 are finite sets, G is a finite group acting on 
each Xi, the number of G-orbits in X ± , X 2 and X 1 x X 2 are respectively m 1? m 2 and m 12 
and /ij is a G-invariant probability distribution in X, with support X, for each % = 1,2. 
For any probability distribution A in any finite set denote by 5(A) its support set. We 
first note that Theorem 3.2 assumes the following form. 

Theorem 3.5 A probability distribution u G K(/i 1; /i 2 ) is an extreme point if and only 
if there is no nonzero real-valued function ( on S(u) satisfying the following conditions: 

(i) ((9x1,9x2) = C(x!,x 2 ) V (x 1: x 2 ) G S(uj),g G G; 

(ii) C{xi,x 2 )u{x 1 ,x 2 ) = ViiGli; 



(iii) Y (( x i, x 2)u(x 1 ,x 2 ) = W x 2 e X 2 . 
xieXi 

Proof Immediate. □ 

Corollary 3.6 Let cji,c<j 2 be extreme points of K(/!i,/! 2 ) and S((Ji) C S'(a; 2 ). Then 
o;i = 0^2- In particular, any extreme point u; of K(/ix,/i 2 ) is uniquely determined by its 
support set S(cu). 

Proof Suppose lo\ 7^ uj 2 . Then put uj = \(oJi + uj 2 ). Then uj G K(/ii, /i 2 ) and uj is 
not an extreme point. By Theroem 3.5 there exists a nonzero real-valued function ( 
satisfying conditions (i)-(iii) of the theorem. By hypothesis S(u) = S(lu 2 ). Define 




the correspondence t — > F p (t) is a homeomorphism of [0, 1]. Put £' = F p (^),r]' = F p (rj). 



X2&X2 



C'{x u x 2 ) 



C(xi,x 2 )uj(xi,x 2 ) 
uj 2 (xi,x 2 ) 



where (xi,x 2 ) G S(cu 2 ). 
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Then conditions (i)-(iii) of Theorem 3.5 are fulfilled when the pair (,uj is replaced by 
contradicting the extremality of uj 2 - □ 

Corollary 3.7 For any uj G K(/xi,/i 2 ) let N(uj) denote the number of G-orbits in its 
support set S(u). If uj is an extreme point of K(/ii,/i 2 ) then 

max(m 1 ,m 2 ) < N(uj) < mi + m 2 . 

In particular, the number of extreme points in K(/ii,/i 2 ) does not exceed 

E (?)■ 

max(mi,m2)<r<mi+m2 

Proof Let uj be an extreme point of lK(/i 1 ,/i 2 ). Suppose N{uj) > m\ + m 2 . Observe 
that all G-invariant real- valued functions on S(cu) constitute a linear space of cardinality 
N(uj). Functions ( satisfying conditions (i)-(iii) of the theorem constitute a subspace of 
dimension > N(uj) — {mi + m 2 ), contradicting the extremality of uj. For any distribution 
uj in K(/ii, /i 2 ) we have N(uj) > m i? i — 1,2. This proves the first part. The second part 
is now immediate from Corollary 3.6. □ 

Corollary 3.8 (Birkhoff-von Neumann Theorem) Let X 1 = X 2 = X, j^X = m, 

Hi — A*2 = (J> where /i(x) = ^ V x G X. Then any extreme point uj in K(/i, (j,) is of the 
form 

u(x, y) = —S a{x ) y V x, y G X 
m 

where a is a permutation of the elements of X. 

Proof Without loss of generality we assume that X == {1,2, . . . ,m} and view uj 
as a matrix of order m with nonnegative entries with each row or column total being 
1/m. First assume that in each row or column there are at least two nonzero entries. 
Then uj has at least 2m nonzero entries and by Corollary 3.7 it follows that every row or 
column has exactly two nonzero entries. We claim that for any % ^ %' , j ^ j' in the set 
{1, 2, . . . , m} at least one among ui^,^/, uj^j, ui^y vanishes. Suppose this is not true for 
some % 7^ %' , j ^ j'. Put 

p = min {uj rs | (r, s) : uj rs > 0} . 
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Define 



uj rs ±p if r 



t, s 



or 



i', s 



ujf s = 



or r = i, s = j , 



uj rs =F p if r = i', s = j 
uj rs otherwise. 

Then uj^ 1 e K(/x, fi), uj + ^ oj~ and c<j = |(c<J + + c<j _ ), a contradiction to the extremality of 
uj. Now observe that permutation of columns as well as rows of u lead to extreme points 
of K(/i, /i). By appropriate permutations of columns and rows uj reduces to a tridiagonal 
matrix of the form 







Pll 


Pl2 





.. 




P21 





P23 


.. 







P32 



















. 












. 



re-ln-2 Pn-ln 
Pnn—1 Pnn 

where the p's with suffixes are all greater than or equal to p. Now consider the matrices 

Pu±p P12TP 

P21 =F P P23 ± P 

P32±P P34TP 



A 



± 



Then A ± G /i) and u; = |(A + + A"), contradicting the extremality of uj and therefore 
of uj. In other words any extreme point uj of K(/x, /z) must have at least one row with 
exactly one nonzero entry. Then by permutations of rows and columns uj can be brought 
to the form 





1/m 


0...0 









UJ l = 










UJ 










where ^zjuj is an extreme point of ~K(p, /i) where /I is the uniform distribution on a set 
of m — 1 points. Now an inductive argument completes the proof. □ 

We conclude with the remark that it is an interesting open problem to characterize 
the support sets of all extreme points of K(yUi,/i 2 ) in terms of /xi and /i2- 
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